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ABSTRACT 


Distributed decision problems arise whenever two or more 
sensors and their associated computers must work coopera- 
tively to make a decision about a commonly observed event. 
Typical examples are in target detection and classification. 
The problem is usually characterized by a limited bandwidth 
of the communication link between the Sensors. 

This thesis develops and evaluates an algorithm for 
distributed decision and compares it to a non-distributed or 
centralized form of the algorithm. Analysis of the algo- 
rithm is carried out for some low-dimensional cases. 
Computer Simulations were carried out for higher dimensional 
cases. The simulation work was done in Fortran under CMS on 
an ~£BM 9370/3033 compute: 


ele. 


15 ae 


EV, 


TApeE Of CONG. 


INTRODUCTION 

A. GENERAL DISCUSSION 

B. BACKGROUND 

Ceo KUe LURE Ob STE THESIS 


BASIC DECISION PROCESSES 

A. CLASS DECISION a ee ee 

B. THE GAUSSIAN DISTRIBUTION FOR RANDOM 
WiGAM@IOP Ge coo os se sw Ue 

Ceeesaees Ss THEOREM 


D. ieee oat BOUNDARY OF CENTRALIZED DECISION 


DISTRIBUTED DECISION RULE 
A. BACKGROUND 
B. DEFINITION 
1. Centralized Decision Algorithm 
2. Separation of Centralized Decision 
Algorithm into x,and y, Observation 
Nector GomponentS . . . .« « «4 -« 
3. Distributed Decision Rule A 
4. Distributed Decision Rule B 


C. eaacee WITH THE CENTRALIZED DECISION 


So IMULATION 

A. RANDOM VECTOR GENERATION 

B GENERATION OF STATISTICS OF RANDOM VECTORS 
C. CLASSIFICATION PROGRAM 

D CLASSIFICATION EXPERIMENTS 


CONCLUSIONS 


10 


is 
i 


if 
16 


18 


Za 
Za 
eZ 
Pia? 


Zo 
2 
Si) 


o5. 


Sy 
S77 
38 
40 
41 


5) NE 


APPENDIX A: 


APPENDIX 


APPENDIX 


APPENDIX 


APPENDIX 


APPENDIX 


B: 


G: 


D: 


Be 


Jae 


GEN FORTRAN 


STAT FORTRAN 


DECAL FORTRAN 


ANAL FORTRAN 


GRAPH4 DATA 


GRAPH32 DATA 


LIST OF REFERENCES 


INITIAL DISTRIBUTION LIST 


Diz 


53 


Ja) 


64 


66 


ju 


76 


7/ 


fF WN Fe 


LIST OF TABLES 


DIFFERENCES AMONG THREE ALGORITHMS 
DIFFERENT VECTORS IN ALGORITHMS 
PARAMETERS IN DIFFERENCE EQUATIONS 


CORRECT veo ne si hid tae a 
VECTORS 


CORRECT poeta ad ey 7 ey wee 


VECTORS 


3 
36 
42 


43 


44 


ho 
fo 


Co Ww 


No PP ff he 
NO tn L 


- 


Jl bps) bal OU seas IL CAI) Se 


Basic Class Decision Procedure 


ce) A Waveform to be Meee saa Aae (b) Observation 
ector (c) Depictiom@or Observation Spae@e =. - 


One Dimensional Gaussian Density Function 
Two-Dimensional Gaussian Density Function 
Decision Boundary of One-Dimensional Case 


Decision Boundary of Two-Dimensional Case 
(Hy per bola) meee. us ky oe ees ater 


Distributed Decision Scenario 
Centralized Decision Scenario 


Block Diagram of Distributed Decision 
Algorithms (aj@iyoe A( DADA eb ew iyre es DL Des) 


Aircraft Type Detection and Observation Vectors 


Operating Characteristics Graph of Test Case 
14=Dimien chien Vectors ee ee Fee 
Operating Characteristics Graph of Test Case 
31 - Dimencniosel Wee Oi: S)) Sa, Vas 5 ee eres CL en 
Operating Characteristics Graph of Test Case 
3% 4 Damen sniaeel WECEOIS@) emmerie sat Geren ne eed io, cc 
Operating Characteristics Graph of Test Case 
4(4-Dimensional Vectors i ee 5 
Operating Characteristics Graph of Test Case 
i430 =D mene oeN VECEOrRS.)) fue eee ee ee x 


ie 


lez 
14 
15 
18 


be, 
a 
24 


30 
41 


46 


47 


48 


49 


50 


I. INTRODUCTION 


A. GENERAL DISCUSSION 

This thesis presents an algorithm for distributed 
decision and compares its performance to that of a 
centralized decision rule. A distributed decision rule is 
characterized by the fact that a decision algorithm is 
distributed between processors of two or more sensors. 

For simulation and evaluation, some programs’ were 
written in Fortran on an IBM 770/3033 computer. The work of 
this thesis is concerned with the analysis of the 
distributed decision rule only. A related thesis by Capt. 
Mark Schon [Ref. 1] is concerned with the implementation in 
real time on a distributed microcomputer system. 

The specific goals of this thesis are to 


i Deven oP and analyze a specific distributed decision 
algorithm. 


2 Generate all necessary data, parameters and statistics 
to simulate the decision algorithms. 


3 Experimentally evaluate the capabilities and 


performance of a distributed decision rule and compare 
it with a centralized decision rule. 


B. BACKGROUND 

In this thesis statistical methods are used to develop 
decision algorithms. Since we deal with many observations 
which represent data collected by the sensors, vector 
notation and matrix algebra is uSed extensively in these 
algorithms. 

The Gaussian distribution is used to characterize the 
observations because this provides a decision rule that is 
relatively easy to analyze and develop intuition. Le also 
provides a reasonable decision rule based on second moment 


statistics (mean and covariance) of the observation data. 


Bayes's rule is used to develop decision algorithms for 
binary decision (class 1 or class 2) and to develop the 
decision boundary concept. Mathematical manipulation of 
Bayes's rule leads to specific decision algorithms which are 
analyzed and evaluated in the computer simulation. 

Since it 1s very difficult to visualize decision 
boundaries in high dimensional spaces, we have developed 
Some computer programs to experimentally evaluate the 
algorithms. The Simulations show that in many cases the 
distributed decision algorithms are quite reliable and 


perform nearly as well as a centralized decision algorithm. 


C. STRUCTURE OF THE Ewes ls 

The remainder of this thesis is structured as follows. 
Chapter II addresses the overall processes of the decision 
rule including probability laws for random vectors and Bayes 
decision theory. The matrix algebra needed to describe this 
is also developed. Decision ruleS are interpreted as 
providing boundaries and regions in a multidimensional space 
that determine decisions made about the observed data. 

Chapter III describes a distributed decision algorithm 
and the form of its decision boundary. Detailed analysis 
and evaluation are given comparing it with the centralized 
decision rule. 

Chapter IV presents computer simulations to test the 
distributed decision rules. To Simulate data collected by 
sensors, an autoregresSSive time series model is introduced. 
Second moment statistics 1.e. the mean, variance and 
covariance of the given random vectors are computed by a 
statistical estimation algorithm. These statistics are 
further used to compute the algorithm parameters. Decision 
algorithms are tested with the generated data and results 
are given. 

Chapter V summarizes the results of the thesis and 
describes the capabilities and performance of the decision 


algorithms. Suggestions are also given for future research. 
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PieebaAS tC mee Gi eONePROCESSES 


eee CLAgS DECESLON 

Sirass decirsicomemeans a classification Glwobjects™ into 
categories. The objects of interest may be radar targets, 
electronic waveforms oor _ signals, printed letters or 
characters, states of a system, or any number of other 


things that are desired to be classified. 


Derive a 


Classification 
Algorithm 








Modify 


(—~ 7] Algorithm = =J*7 77 7 





Classification 


a Teacher 
Algorithm Results of 


Classification 

















Pieure 2.1 Basie Class Becision. Procedure 


In testing a class decision algorithm the individual 
classes of objects are presumed already known. The basic 
BrocedUre Tor a class decisiom is ullustrated in Fig. 2.1. 


A portion of a known set of labeled objects is extracted and 


iat 


used to derive a classification algorithm. These objects 


comprise the "training set". 





Figure 2.2 (a) A Waveform to be Recognized 


(b) Observation Vector 


(c) Depiction of Observation Space 


The remaining objects are then used to test the 
classification algorithm and these are collectively referred 
to as the "test set’. The performance of the algorithm can 


be evaluated because the correct classes of the individual 


i 


Seaects in the test Set are known. The result of 
classification is supervised by a teacher who may dictate 
suitable modifications to the algorithm. 

A simple example of a class decision is presented to 
illustrate its approach and to define some relevant 
concepts. Fi . 2aeeea(Cas) illustrates 32-dimensional 
observations of electronic waveforms. Thgé v@ctom x. 18 
called the observation vector and the multidimensional space 
in which it resides is called the observation space. These 
are depicted in Fig. 2.2(b) and (c). 


Every problem in class decision has at least two things 


in common. First, an exact description of the various 
classes of objects cannot be obtained. Thus the class 
decision is inherently a probabilistic topic. Secondly, the 


objects are represented by vectors in a multidimensional 
Space. Thus the observation vectors of the objects to be 
classified are multidimensional random vectors which must be 
described in a Seat sted sense. Similar ly, the 
performance of the algorithm must also be measured in a 
statistical . sense. Thus an adequate background in 


probability and statistics is important for these problems. 


B. THE GAUSSIAN DISTRIBUTION FOR RANDOM VECTORS 

In engineering and many other areas, the Gaussian 
distribution is frequently encountered. It describes 
certain phenomena well with just two parameters, namely the 
mean and the covariance of the random variables. The 
Gaussian density function for one-dimensional random 


Vartrables 1S: 


l 
x)= ——— exp |] - —- —— (2) 
pK ) Jin. 9 


ILS, 


Fig. 2.3 shows a one-dimensional density function Pp, (x) with 
2 


its mean value m, and variance ae 


x 





Figure 2.3 One Dimensional Geussian Density Function 


In the two-dimensional case (i.e. two random variables) 


the Gaussian density function is: 


er 1 - 1 (etal as 
oi 270,0, eee 2(1- ae } or 
2.2 
(on, )() a a ae ee? 
rece oF 
0,0, oy 


14 


Fig. 2.4 shows a two-dimensional density function Pe y (X,Y) 
b 

with its mean values my and my» 1ts variances a and ee 

and the correlation coefficient p of both random variables 


meamdey (Ref. 2: p. 158]. 


oO 
v 
OC 
iis. «~~ 
- ae 
Oe 
» & 
Figure 2.4 Two-Dimensional Gaussian Density Function 


The Gaussian density ip ehgvene atop ol fOr two sets of 
multidimensional random variables x and y is expressed by 


the combined vector z and its parameters as follows: 





i 


where 


Kf) BL) 


BIT KE 5 1=1,2 (2.4) 








2+ Lg 2°- [3] * 


Observation vectors x and y are N and M-dimensional 


x 
dimensional, and they represent the expectations of vectors 


respectively. The mean, cote ome nc my, are also N and M 


je. moe ECan my, = EL(y)]. The covariance matrices 
[K,] and [Ky] are of size [N X N] and [M x M] respectively 
and represent correlations among the components of x and y. 
The matrix [Bay] is of size [N x M] and represents cross 
correlation between the components of the vectors x and y. 
' These matrices are also defined by expectations of vectors 
te. Kye " Seatien Ky = E[(y-my)(y-my)*], 
Byy = El (x-m,) (y- m)7) 


C. BAYES'S THEOREM 


Bayes's theorem is uSed to convert prior probabilities 


and 


into posterior probabilities. The form of this theorem that 


18s useful togus, 1s- 


)p, (w ) @2.5) 
z) 


p,(w([z)= 


p(zl|w 
( 


where qw represents an event such as “object belongs to 
class 1". The term Pela) is called the prior probability 
of the event and the term P,(w|x) is called the posterior 
probability. More generally, let QM]. WO. scene os be 


mn mutually exclusive classes exhausting the set of all 


16 


possible classes of the 


objects. Then the 


condatt Loma 1 
probability law gives this following equation 


zilw 


(meas) 


a) oe st  tege2, on (2.6) 


where p(x) = 2 p Cala, Peo. If we consider the case 


where observations consist of two vectors x and y and assume 
that there are only two 


classes, class 1(w}) 


and class 
2(wo), the above equation becomes 


If we make a eclass decision based 


on the posterior 
probabilities, that is 
Wy 
> | z 
p,( wi) zy) > Pel v2] Zw (2.8) 
Ww? 


then Eqs. 2.7 and 2.8 lead to the likelihood ratio test 


ae ; 
ptt hes flo aii 


where we have used the notation p,(x,y) 


to represent the 
class 


Sengutiemal density piGay lw) Lf the. likelihoc@ 


7 


ratio 1l(x,y) for specific obSseryatuuon Byectors es. ancy een 
greater than a threshold vale “—Dthen =elasc 1G, =e 
chosen. On the other hand if the ratio is less than T class 


2(wo) is chosen. 


D. DECISION BOUNDARY OF CENTRALIZED DECISION RULE 

Although any decision rule for our problem is at least 
two-dimensional, corresponding to observations x and y, it 
is still instructive to look at the likelihood ratio for a 
single variable ae The decision boundary eye a 


one-dimensional case is relatively simple as Fig. 2.5 shows. 


CHOOSE CU), 
BOUNDARY POINTS 


CHOOSE W, 


CHOOSE Wy. 





Figure 2.5 Decision Boundary of One-Dimensional Case 


The decision boundary is just given as a set of points on 


the x axis. 


18 


In the two-dimensional case the decision boundary is 


more complicated. For Gaussian random vectors it could be a 
straight line, ellipse, hyperbola, parabola or a 
combination. 


L \ : R2 


Figure 2.6 Decision Boundary of 


Two-Dimensional Case (Hyperbola) 


Fig. 2.6 shows an example, if observation variables x and y 
are outside the curve lines i.e. in region 1(R,) the 
decision is class 1, if inside i.e. in region 2(Ro) the 
mectsion is seclass 2. 

When the dimension of the observations is more than two, 
it is more difficult to visualize the decision boundary but 
the concept is still useful. A centralized decision rule 


Paeemene Xen y vectors topethersdirectily in its algorithm. 


ro 


All equations use joint probability densities such as 


P1(X,y), pPo(x,y) which determine the multidimensional 
decision boundary. 
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Lil »sDISTRIBUTEDADE EES LON RUE 


A. BACKGROUND 


The AEGIS weapons system simulation project, currently 
being conducted at the Naval Postgraduate School, is 
attempting to determine the feasibility of replacing the 
larger and relatively expensive mainframe computer, the 


AN/UYK-7, with a system of 16 or 32 bit VLSI computers [Ref. 
Sle. 








OBSERVATION 
VECTOR x, 


OBSERVATION | 
VECTOR ¥, | 
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COMMUNICATION 










PROCESSOR PROCESSOR 


Pageuae 3.1 Distributed Decision Scenario 


As the capabilities and performance of microcomputers 
continue to imvrove, it is becoming apparent that an 
integrated multiprocessor system of less expensive, compact 
microcomputers can manage many real-time applications that 


have previously used mainframe computers. This set of 


21 


microcomputers has been used to demonstwacemoun aisten oleed 
decision rule in a realistic environment[Ref. 1]. The 
computers have been organized to simulate two sensors 
observing the same object for purposes of detection and/or 
classiiaeatto0n, 

As illustrated in Fig. 3.1, Sensor A “dealismwath _the 
observation vector x, only, while semsor B deals warhesthe 
observation vector We exclusively. A centralized decision 
rule uses both observation vectors X, andy, 42 once aia 
Single processor to determine its decision. 1G ge 
distributed decision procedure, each processor cannot use 
both vectors together because of the limited bandwidth 
communication. Nevertheless, by exchange of Some minimum 
essential information, each processor makes a decision which 
is quite reliable. The concepts will be developed 
mathematically in this chapter and tested experimentally in 


the following chapter. 


B. DEFINITION 
In order to introduce the concepts of three decision 
algorithms here each algorithm is presented mathematically. 
These algorithms are: 
1 Centralized Decision Algorithm (C.D.A) 
2 Distributed Decision Algorithm A (D.D.A) 
3 Distributed Decision Alecorithm By Dabee 


l. Centralized Decision Algorithm 
The concept of a likelihood ratio was introduced in 


Cheaper eeocetion. C From the likelihood ratio the 
centralized decision rule is derived. The likelihood ratio 
for Gaussian data is expressed (using Eq. 2.3 and Eq. 2.9) 


as follows: 


Ze 





ee s Pilz) | 
po( z ) 
eal, 
|K™ |  Pexp Fe = a) ~ mI) 
_ti 
|KO] Pexp Fle - aT = me) | - 
a | 
> P, (we) -T 
s p,( w, ) 


wmewre vector Z, mi) , and matrix rK(1)5 were introduced in 
Eq. 2.4. Here the subscript 1 and 2 means class 1 and class 
2 respectively in the two class case. Taking the natural 
logarithm of both sides of Eq. 3.1 yields this following 
centralized decision algorithm: 
= 
1 ate m®)T KO 2 — me) _ 


u 


] 
M4 
eer, ae). pe eT 
nol plies a — ) KM) < 


W2 
Such a centralized decision procedure is shown in Fig. 3.2. 
ip 2 haa of oh Decision Algorithm into x, 

and y Ubservation Vector Uomponents 

Although Eq. BV adequately represents the 
centralized decision rule, we want to put it in a form 
involving vectors x,, Separately and certain partitions 
of the matrices K(1) | K (2). m(1) | and m(2) for the two 
classes. This will help us to develop the distributed 
decision rules and enable us to more directly compare the 
distributed rules to the centralized rule. Fig. 3.2 shows a 
Scenario uSing both obServation vectors in a centralized 
processor. To develop a distributed form of the decision 
algorithm, we proceed as_ follows. Using a conditional 
probability law the joint probability p(x,y) is equivalent 
EO. 
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CENTRALIZED PROCESSOR 


Figure 3.2 Centralized Decision Scenario 


Taking the log base e of both sides leads to: 


) =dn p; (ee) +In pj(yl|z), 1=1,2 


< 


In p, ( 


|e 


3 
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( 33539) 





(3.4) 


Eq. 3.4 shows how the probability density can be distributed 
imtoo two parts, where one part is a function of ‘x only and 
Evemolbner part is a function of y given x. For the Gaussman 


case the probability density function of random vector x is: 


p;(z) = N 1 
a 2 


(27)? | K})| 


(3i") 


exp |- > [2 - mT (KO [2 - mO)], i=12 


ines conditional probability density function of vector y 


given x[Ref. 2] is: 


] 
(OS ET Ves a WN T 
Cec | Kf), | ° 
(2.6) 
1 t +) 7- ! ° 
exp |- > [uy - my)? [AULT Ly - mir) ]. f=12 
where 
ae x , i)T 1))- { a 
Kf), = Kf) - BY) (Ke eee = 1,2 Cr) 


Vas) 


and 


Vie ml) 4 (BLY? KL fe — mm!) , =1,2 (3.8) 


In Eqs. 3.7 anda. [Ky } x] and my)x ise ds dmc, 
calculated using all parameters and both observation vectors 
Yo sand xX) direc Thus the conditional probability 
density Veawetmion P(y|x) is determined without any 
difficulties. Using the above expressions Eqs. 3.5 and 3.6, 
Eq. 3.1 becomes: 


pPiizy)  pilz)pilylz) 
Po zy ) Dol to) 2 Ue) 
_ 1 
pK!) ‘ew |-blz-m ON? (KN [2 - m0) 
i 
kK.) ‘exo |= ble-m 7 (K: (a — mi | 
l 
= ee 
| K, Gy : ao |- = [y - my(),)7 a2 [a= m,|}),] | 
l 
| K,'?), | exo f= Stan mPa GSP. La = mA 
< p, (Wo ) 
= T 
>, p,(w, ) 


Finally by taking the natural logarithm of both sides, Eq. 


3.9 becomes: 
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Uy 


> 
Aa (Zo) + As (Yo! Zo) & InT (3.10) 


W 2 
where 
I. 
Aa (Zo) = a apm in, \”)|? (KY)! [zy — m,)] 
(“Sigacliadlag) 
K (2) 
= [25 ~ ma [KJ]? [29 ~ m,(0) + tn REL 
| Kf") 
AB (¥o| Zo) = = | [yo - m,'?),|7 [K{)]7! yo — m, ? 2) | 
( Saaz) 


| Kyi’ | 
ios my!}),]7 i) [Yo — my), ] + In 0H 
y | z 


Eq. 3.10 suggests a distributed form for the decision rule 
which is described in the next section. 
3. Distributed Decision Rule A 
Tage shows “that processor A uses’ vector x2 only 
and processor B uses vector y, only. In this distributed 
deecusion,ruley the processor Awwhich is to compute A,(X,) 


has no problem because it observes vector x, directly and it 


ae 


has all the other parameters needed in Eq. 3.11. Processor 
B, which is to compute Nall Sai): has a problem however 
because it does not have dimeclac Cs 2 roi em oero sealant c 
observation vector appears” in Eq soe ete 2 eles 
dependent on Xo 

If there exists a way to estimate the observation 
vector xX, using known parameters and sensor B's own 
observation vector y,, then the estimated x which we denote 
by &. can be used in Eq. 3°90  instedd (or es tee dee 
procedure 1s known as a generalized likelihood ratio test 
[Ref. 4]. In this case sensor B will have no problem in the 
computation Since it iS assumed that the other parameters 


necessary to compute My |x and K are already known. 


y|x 


X,;» Processor B considers the 


To obtain an estimate 


following conditional density: 


l 
Py dl SS 


Cag) | ES | 


exp |- >[z2- mis)? Ke)" [2 - mij], ¢=1,2 


In particular processom Bs Vehoos os wats epeic we 4 tlc eer an 
maximizes p.(x|ly). Because of its Gaussian form, Eq. 3.13 


is maximized when x = From the symmetry of Eqs. 3.6 


a ys 
and 3.13 the following estimate is obtained(see Eq. 3.8). 


mf) = mi) + BY) KL)! [ys ml), f=12 (3.14) 
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Now processor B can use x which is calculated by 
known nga, a is ey [K,], my,» and it¢ owm 
observation vector Yon on iq. 3.10 _ ee implement a distributed 
decision algorithm. In this algorithm Eq. 3.10 is modified 
tomtme» form: 


a 


4 oe 
Na (Zo) + AB Yo) & Int COMMITS ) 
W 2 
where 
Ap (yo) = AB (vol &) (ro) 


and where Ap l¥g/;) rs giveumoy Eq: 3212 q7iEhex. 
by ®; of Eq. 3.14. Specifically €, will be used in the 


computation of m (1) 


replaced 


yix and Hy will be used in the 


y|x 
Mie “term <A,(x,) is exactly the same as” in Eqs. 3.10 and 


Sarl. 


computation of m2) as these terms appear in Eq. 3.12. 


Let uS summarize the the results as follows. In 
Pomomcdictribated decision rule .A A,(x,) is the same as was 
Shown in the centralized decision rule of Eq. 3.10. However 

Bo? is different from ine | ay in the centralized 
decision rule. Actually misty.) 15 Simp ketited mneiation 
for the term yale ae Both Aa (Xo) and A'ply,) are 
Single statistics Mie must be added together and compared 
to the threshold value T to decide the class of the observed 
Gpgect . These Stoic ties Aa (Xo) and espe, ) are 
Guicorayed ine aq.) ard’ 3.16. 
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Figure 3.3 Block Diagram of Distributed Decision 


Algorithms (a) Type A(D.D.A) (b) Type B(D.D.B) 
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The single statistic A'ply,) which is calculated 
im processor.B 1S transmitted to ‘processor @ through the 
limited bandwidth communication link. Processor A will then 
have both its own calculated statistic Nae) and the 
Statistic KB Gg? received from processor B. Therefore it 
can decide the class of observed object using Eq. 3.15. Eq. 
3.15 is called distributed decision rule A because the class 
decision is made in processor A. This algorithm is 
melustmated in Pie. 3.3 (a). 

4. Distributed Decision Rule B 

Distributed decision rule A was considered in the 
previous section. A symmetric form of this algorithm is 
illustrated in Fig. 3.3(b). This algorithm uses a symmetric 
Berm of the conditional probability law of Eq. 3.3. 


Py) ) (S°.. ) 


\\ 
»s 
Fee 
irc 
wee 
ss 
ES 
|e 
lec 
wee” 
iI 
j—ad 
NO 


which leads to: 


imp, (25) = lnepaley ) + In p, ely) 1 =1,2 (3.18) 


By analogy and symmetry with the equations used in 
distributed decision algorithm A, the following algorithm is 


derived 


Wy 


; > 
Ag (Yo) + Aa (Zo) & InT (SPE) 


ws 
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where 


i 
AB (Yo) = % yo - ee [K 2))-} [Yo — m,'?)} 


Csr 728) 
: | K ) 
= (eee IK! fy — my) + In 
| Ky" 
1 
A4 (Zo) = Py [Zo — mn) |" [K St acre m,() | 
(3.215) 


K 
— (29 — mT? KM] [zo - mm), | + In ae , 


where Ryly and Myly are computed from equations analogous to 


Eqs. 347 .sand aoc Processor B calculates’ the 
Stadtisere Ap(y,) using its own 


Processor A computes the 


Single 
observation vector Yo 
Single statistic 


Nag CS), using 
the following estimate for the vector y: 


noe m,|}), = m, |") a BLOT (Kf)! [z — m,")] , i=1,2 (32223) 
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Thus )',(x,) is a simplified notation for A,(x,|9;) and 
Hes cratsmitted to processor B through the communication 
link. Therefore processor B computes AplY¥q) locally and 
Receives } ,(x_) from processor A. Then proeessor B makes 
a decision about the class of the observed object using Eq. 
3.19. This procedure represents distributed decision rule B 


because the class decision is made by processor B. 


C. COMPARISON WITH THE CENTRALIZED DECISION RULE 

Three algorithms were introduced and explained in the 
previous sections A and B. Table 1 shows the differences 
among them very briefly. Notice that the two forms (Type A 


and Type B) given for the centralized decision rule are 


equivalent. In distributed decision algorithm A, processor 
B uses the estimated value %; instead of the observed value 
fanaa, sends the result x pein) lOmpprocessor” A- In 


| distributed decision algorithm B, processor A_ uses V4 
iieeeadeet y, and sends jA ,(x,) to B. These differences 
are visualized simply in Table 2. 

Use of the estimates om in distributed decision 
algorithm A, and Y; in distributed decision algorithm B 
makes the results of these algorithms different from each 
other and different from the centralized decision rule. 
Further, the use of rules A and B together can result in an 
ambiguouS Situation where the two decisions are different. 
This can be resolved in a number of ways discussed later. 

The key components which make the algorithms different 
from one another are the uSe of the estimate fa 150) 
distributed decision algorithm A, and ¥; in distributed 
decision algorithm B. If the estimated vectors 2. and A 
Bee clGscmeeammtne actual observation “vectors x, and Yy,, 
respectively then the results of the distributed algorithms 
A and B would be close to each other and close to the 
centralized algorithm. Although we have not been able to 


characterize theoretically the relative performance of these 


os 


algorithms we can show their results experimentally on a 
number of different test cases. These results are given in 


the next chapter. 
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IV. SIMULATION 


This chapter contains an evaluation and comparison of 
distributed decision rules A and B, and the centralized 
decision rule. The generation of random observation vectors 
and the calculation of their resulting statistics are 
discussed in sections A and B. In Section C the results of 
the decision algorithms are compared to the results obtained 


from classification using a centralized algorithm. 


A. RANDOM VECTOR GENERATION 

The observation vectors x and y are generated by using a 
linear difference equation with white noise excitation. 
This difference equation can model, for example, the time 
Series of radar cross section values that result when the 
' target is observed by the sensors over a relatively short 
period of time. If W, and Wy are independent white noise 


processes this difference equation has the form: 











ie) _ a( I — 1) A a it — 2) 
Rel afeUronys ° wee 
(4.1) 
3 (Tn r i( J ) 
a cceealees w{ I ) 
where 
ee 
Ar =) 0) gl Cas, 
yz y 





a7 


This generates a pair of time series for x and y that are 
correlated and "naveusZeLo mean. The measurements x and y 


that represent the observations are then defined by: 


Seid (ae 4.3 


where m, and my, are the mean values of the observations. 
The observation vectors x and y then represent n samples of 
the time sexies. In this procedure ts seo cumec ae 
and hee are given in advance and that white noise Wy, (I) 
and Wy (1) have been previously generated and are available 
in a white noise data file. 

The difference equation is implemented by a program with 
the title "GEN" [Appendix A]. If, for example, the 
observation vectors x amd yo have 32 time poinesmedch sana 
set of 128 independent vectors is needed then the program 
GEN generates two data sets. Each is an array of size 128 X 
32 whose rows represent individual vectors x and y- These 
data are written to the disk with file names such as "X11", 
"X12", “Y1LL", and “Y12" to be Wused later an ene sdees sion 
test algorithm. In the file name X12 the first number "1" 
represents test case one, and second number 2 stands for 


elass> 2 data. 


B. GENERATION OF STATISTICS OF RANDOM VECTORS 

After the obServation vectors in files Xll, Yll, X12, 
and Y12 are generated, the joint statistics of these vectors 
are calculated. The statistics are used in the decision 
algorithms. 

Let the dimension of the vectors be N and M and the 
number of vectors generated be L. Then mean, covariance, 
and croSS covariance parameters are calculated uSing the 


following equations: 
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1 L, 
i = aie (4.4) 
kez j 
1 L 
e, = 9 By’ (4.5) 
ce—1 
K = 2b oy clk) (k) r (4.6) 
: a =a) ea! — eee 
ig, tk) (k) T 
Ky = 7 dly — m, )(y'’ — m, ) (4.7) 
1 Sy p(k) (k) r 
i Te aay ES =n ey = ing) (4.8) 


i) 


Observe that two sets of each of the parameters in Eqs. 4.4 


- 4,8 are required: one set for class l and one set for 
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class 2. These calculations are performed by the program 


"STAT" [Appendix B] and the parameters are written to output 


files. From the file of vectors X1ll the program STAT 
generates m, (1), and px Bs ‘/ £rom Yili eroduess m, (1) 
and [K, ‘1)) - and from both ©X 13 ange vi) vijcwme a teulleaees 


(pa eel These represent the statistical parameters of the 
class 1 data. The files X12 and Y12 are uSed in a similar 
manner to produce m, 62), Bens?) rhea pee, and 
Be I These represent the statistical parameters of the 
class 2 data. 


C. CLASSIFICATION PROGRAM 

When observation vectors and their statistics are 
available, one can test the distributed classification 
algorithms and compare their results to the results of the 
centralized algorithm. A program "DECAL" [Appendix C] was 
written to implement these decision algorithms. This 
program has three main partS consisting of distributed 
decision rule A(denoted simply by "A"), distributed decision 
rule B(denoted simply by "B"), and the centralized decision 
rule(denoted simply by "C"). In this program every 
algorithm computes its own log likelihood ratio statistic to 
be compared to the threshold value. The statistics 
corresponding to each pair of obServation vectors for each 
of the decision rules, A, B, and C are written to a disk 
file and used to compute the correct deciSion rates. 

A Fortran program “ANAL" [Appendix D] generates the 
varying threshold values that are used with the data 
generated by DECAL to decide upon the classes of the 
observed objects. ThisS organization of programs allows us 
to generate classification results for many threshold values 
Without excessive computation. The threshold values are 
expressed in terms of the prior = probabiliticsm@p (a ie 
P,(w 9) which are chosen so that the condition of -paGaw) + 
Palws) = 120" geeisatiseged: 
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D. CLASSIFICATION EXPERIMENTS 
ie “2 coOrgect analysis Ms perfommed, on@ can fit an 
appropriate time series model to the sensor data to 


fepresent the observations ‘made on two disStinet typés of 
Camepets such as» thoseeshownein Figs 4. ls 


Class 1 Class 2 
F-15 C-5 
Object 


X11 


SENSOR LIMITED BANDWIDTH 


(A) COMMUNICATION 


rT rOCESSOR PROCESSOR 





Figure 4.1 Aircraft Type Detection 


and Observation Vectors 


For the analysis here we are more interested ian 


characterizing the distributed decision algorithm 
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performance for various second moment statistical properties 
of the observation vectors, such aS mean, variance, and 
correlation. The cases chosen for analysis should not be 
interpreted to mean that we are attempting to model real 
target data. 

For our experiments, we generated data according to Eqs. 
4°  throtign “4 3 swt the order of the difference 
equation(p) equal to. one. Four different cases “were 


considered; their parameters are given in Table 3. 


TABLE 3 
PARAMETERS IN DIFFERENCE EQUATIONS 


TEST CLASS 1 CLASS 2 
¥ 
CASE NO [A)] O51) say 
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Each test case used data from two different classes. In all 
but case I the filter Wcoettuerents (Ay) andyer ee. 
covariance matrix Peeeieons resulted in observation vectors x 
and y that are correlated with each other. If the 
observation vectors x and=sy are uncorrelated, the 
conditional probability density function p(y|x) becomes the 
same as the unconditional density function p(y). If this is 
true for both classes, as in case l, then the three decision 


rules A, B, and C will be equivalent. 
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Several specific cases are represented here. In cases l 
and 3, the class 2 filter has negative A, parameters; this 
makes the time series change very rapidly up and down. 
semnees the data of class Iwdoes not have this™property, we 
expect that the decision rules can discriminate between the 
two classes based on the correlation of the time series. In 
Gost case 2, class® 2, has non=zéro" mean while clas® 1 has 
zero mean. Since the mean values are the only differences, 
the classification can only be based on these differences in 
the mean values. In test case 4 the mean values are also 
non-zero but both the class 1 mean and the class 2 mean are 
the same. [In addition, the filter parameters for each class 
and the noise covariances are very similar. This makes the 


classification of the observations a relatively difficult 

















problem. 
TABLE 4 
CORRECT DECISION RATE(%) | 
4-DIMENSIONAL 128 VECTORS 

TEST CASE CLASS A B : | 
CASE #1 CLASS - sib? 85.9 85.2 | 
CLASS-2 84.4 85.2 82.8 | 
CASE #2 GEASS tie 3.0 93.8 oma | 

CLASS-2 85.2 85.9 89.1 

CASE #3 CLASS-1 81.3 83.6 B02 
CLASS-2 85.9 86.7 85.9 | 
CASE #4 CLASS-1 85.9 7S) 5770 | 
ASS-2 10,5 17.2 60.2 | 


The results of classificatwenmn for these test cases is 
Saowme wm Tables 4 and 5. Thew results “are based “6n a 


threshold corresponding to equal prio®m® probabilities: The 
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first test set was 94—- dimensional (1.6. 9x = ance cach 
consisted of four time samples) and consisted of 128 pairs 
of observation vectors x and y. These results dreme1vchmam 
Table 4. Most of the results show probabilities of correct 
classification in the range of about 85 to 90 percent. For 
test case 4 the probability of correct classification 
achieved by decision rules A and B is quite high for class l 
but very low for class 2. However, if the classifier 
threshold is adjusted by choosing different priser 
probabilities, the results are similar (but slightly worse) 
than the results for the centralized rule C. (The reader 


may refer to Appendix E. ) 


TABLE 5 
sSOBREERSPBCAET Me WEELRRs 
Thom CAcH CLASS A B 
CASE #1 CLASS-1 100. 
CLASS-2 100. 


CASE #2 CLASS-1 100. 
CLASS-2 100. 
CASE #3 CLASS LOGr 
CLASS-2 99.2 
CASE #4 CLASS= loge 
CLASS-2 ~ 11323 





The second test set was 32-dimensional and again 


consisted of 128 observation vectors x and y. The results 
are given in Table 5. Note that in cases l, 2, and 3 all 
vectors were classified correctly. That shows that the 


classes are easily separated by any of the decision rules if 


32 time samples are uSed. 


o4 


In test case 4, the degraded performance is explained by 
the parameters in Table 3. Here both classes have similar 
correlation parameters, and both mean values are identical. 
This case was designed to be the most difficult. 

By varying the prior probabilities one can change the 
threshold in the decision algorithms and therefore trade off 


einem probabilitye of correct classifieation of ome classe for 


mmeottect elassification of the other class. A graph of 
these probabilities is known as an "operating 
characteristic" for the decision rule. The results in 


Tables 4 and 5 represent a single point on each of the 
operating characteristics. Operating characteristics» for 
cases 1,2,3, and 4 of Table 4 and case 4 of Table 5 are 
given in Figs. 4.2 through 4.5. The three different types 
of lines in the graph represent the results of the three 
different algorithms. These results are also given as 
tables in the Appendices. (he commectemdeci sien rake) 15 
shown in the output data "GRAPH4" [Appendix E] for the 
4-dimensional cases and "GRAPH32" [Appendix F] for the 
32-dimensional cases. 

It is interesting to note that in most cases_ the 
performance of the distributed decision rules compared 
favorably to that of the centralized decision rule. It is 
also interesing to note that the performance of decision 
rules A and B was always close together although the data in 
the test cases exhibited no symmetry in their defining 


paLanerers. 
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Figure 4.2 Operating Characteristics Graph 


of Test Case 1(4-Dimensional Vectors) 
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Figure 4.3 Operating Characteristics Graph 


of Test Case 2(4-Dimensional Vectors) 
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Figure 4.4 Opecating Characteristics Graph 


of Test Case 3(4-Dimensional Vectors) 
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Figure 4.5 Operating Characteristics Graph 


of Test Case 4(4-Dimensional Vectors ) 
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Figure 4.6 Operating Characteristics Graph 


of Test Case 4(32-Dimensional vectors) 
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V. CONCLUSIONS 


The specific goals were all met in this thesis. The 
distributed decision rules were introduced and compared to 
the centralized decision rule. Since only one observation 
vector (either x or y) is available in each processor, the 
results of the distributed decision rule can not in general 
be the same as those of a centralized decision rule. The 
decision algorithms were explained mathematically and 
compared to one- another. The difference between the 
algorithms arises from the fact that one sensor. must 
estimate the observation vector of the other sensor using 
the locally measured cbservation vector and all available 
parameters. Simulation experiments for a number of cases 
with different statistical properties showed that when 
multiple observations are involved, the two distributed 
decision rules compare favorably to the centralized decision 
rule. Even when the vectors have high dimensionality, only 
a fixed limited amount of interprocessor communication iS 
required. 

In the two distributed decision rules, if each processor 
has a different class decision for the commonly observed 
object, an ambiguous situation results. In thisease, one 
can either disregard that decision or use the following 
method. By comparing each log likelihood ratio statistic to 
the threshold value, one can select the decision which is 
further from the threshold value. This procedure is 
intuitively reasonable because decisions made when the 
statistic is close to the threshold value(observations in 
the region near the decision boundary) are more likely to be 
incorrect. 

Further research may center on analy cared | 
characterization of these distributed decision rules and 
further analysis of the situation where the two rules A and 


B do not agree. 
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APPENDIX A 
GEN FORTRAN 


This program generates two sets of random observation 
vectors 1.¢) svaiesnda 


REAL*8 A(9,2,2),MX,MY,XP(32),YP(32),X(32), 
+ $6335 20 RNY Ot 34) bh S34) ee) 
INTEGER H,I,J,K,L,M,N,P 
Neo? 
M= 32 
Por 
READ(2,*) MX,MY 
READ.) Ale J K) Ke] 2) ,J=1 2), 1= ees 
READ(2,* Wi, J),J=1,2).0=1)2) 
READ(3,*,END=50) (W1(1L),I=15N 
Taeeee ate) tet HS 
RB (LJ=KW(T, LYAW1 (1) +RW (2,2) 203 (1) 
YP(1)=KW(2,1)*WL(1)+KW(2,2)*W2(1 
DO 36 1=2- 
XP ee. 
YP 1S (0 
IF Cl {GEE eRe 
L=i-0 
DO 20 J=LeK | 
XP(1)=XP @w)+A(J.1,1)*XP Ge eA (J. ee?) 
yP(I)=¥P(I)+A(J,2,1)*XP(L)+A(J,2,2)*¥P(L) 
CONTINUE | 
XP(I)= RECT) + SHOR O LED + KWe) 3) eW3 (1) 
YP(I)= YP(I) + KW(221)*WL(L) + KW(222)*w2(I 
CONTINU 
DO 40 I=1,N 
Meare leant 
Y(I)=YP(1L)+MY 
NTINUE 
WRITE (7,41 (X(T), 251,N) 
FORMAT(1X,4(2X,E1 8)) 
WRITE (8,42 (x(1), 25 ,M) 
FORMAT (1X,4(2X,E15:8)) 
eo 10), 16, 
STOP 
END 


Sy! 


Oo” 007-750) 


@) 


Qo onan 
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+++ + 


APPENDIX B 
STAT FORTRAN 


This program computes all the necessary 
parameters of the given sets of vectors 
ie. Nil amadeyil;, op xezmanider| 2 . 
Matrix manipulation subroutines are 
Promerne IMSbelibrary [Ret. 5]. 
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APPENDIX 
DECAL FORTRAN 


This program computes the final scalar values 
of three different algorithms which will be 


compared with the threshold value. 
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Matrix manipulation Subroutines are from 
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the IMSL library [Ref. 
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IKY 


CALL VMULFF 
CALL VMULFF (IKY 
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=>. oe. tn SS une AA ST ce SS SS SZ OMe WS MINS - rs m———_  FOAOQHAQ PH ‘a 
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aN HH HR “a - pom se HN HH AN ae Nn aa rN = Nk —H1 O- Hoa MNS TNS 
Om i-- WH AN ABH AN SES 8 ek AHH AN OM AN SEE <P aa rw Ou a Se Apa oN 
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READ(4,* 
READ(5,* 


Nann00 aA FANn0N 
1S) 


DO 50 N 
M2=SUM2+B1(I)#X(I) 


SUM1=SUM1+X(1)*Al1(1,J)*X(J) 
50 CONTINUE 
RX=0.5*(SUM1+SUM2+C1) 


WMH OOODODO0O00- + + « « 


oe eS 


DO 60 I=1,M 
SUM3= SUM5+B2(1)*Y(I) 
DO 60 J=1\M 
SUM4=SUM4+Y(1L)*A2(L,J)*Y(J) 
60 CONTINUE 


RPY=0.5* (SUM4+SUM5+C2 ) 
(a 
e 
VAL=RX+RPY 
Ee 
(a 
ee THEN 
NCLASL=NCLAS1+1 
ELSE 
CLASS=2 
NCTAS2< NCLASZa 
ENDS ce 
Cc 
c 
c ? ¢ LJ ' ? ? ¢ ° ° ¢ 9 t ? i) ty ¢ 3 y , 
Cc Se Se Se eo oe se oe 2 ee ee a eee 
GNSS ce ce ae ae DI STRIBUTED RULE B Nipdiaaias RO ee ee Oe tR ee oe Be oe oe FOUR 
Cc ne eae BOTS i hans 
ESUBROUTINES #1: !: 
( 
e 
c 
100 CALL VMULFP Say OT NN NN RRND NM TER} 
CALL VMULFP (BX2Y;BXY2;N.M.N.N.N,BRKX2.N, LER 
Cc 
e 
GALL Vitiieie bBx Sy BB1X, NOM NN Mt, Bay N TERY 
CALL. VMULEF “CBiwzy BB2X., M, Newiererexz ,N, LER 
Cc 
c 
CALL VMULFF (BY), ME}.NN, PWNS Gey ATER) 
CALL VMULFF (BX2,MX2;N.N.1.N;N,B2MX.N.I1ER 


+ 
130 CONTINU 


DO Nt 
MEE Oech lt y-BIMATL 
EZ Saeerix2 (Le B2Meet TL 
CONTINU 


CALL VMULFF (MY1,IKY1,1,M,M,1, 
CALL VMULFF (MY2?IKY2?13>M)M? 1? 


ae 
ae 
rr 
Noe 
are 
HH 
bint 
Aw 


DO 120 I=1.N 
DO 120 J=1,N 
KXV1(1L.J)=KX1(1,J)-BKX1(1L,J 
KRY2 (1 J) =e Te SBR M2CT I 
KXY1LD(I,J)=KXY1(1,J 
RXY2D(1I.J)=KXY2(1,J 
CONTINUE 


CALL LINV2F (KXY1,N,N,IKXY1,IDGT,WKAREA, IER 
CALL LINV2F (KXY2°>N>N; IKXY2?IDGT;> WKAREA.IER 


CALL DTERM (N,KXY1D,DKXY1,N 
CALL DTERM (N;KXY2D;DKXY2-N 


Gal yMULB (LKXYI , BX 1..N , NNN , N N TER 
GAEL VMUIEFF ( BKXY2,BxXZ,N,N,N,N,N,IBX2,N,1ER 


CALL VMULFF oe Oe eee | 
CALL VMULFF (IKXY2;MB2X;N;N.1,N,N,1XB2,.N,1ER 
CALL VMULFM pee tay} NONNN.N.BXI).N, TER) 
CALL VMULFM (BX2;IKXY2,N;N.N.N,N,BXI2.N,I1ER 
CALL VMULFF (BED) BE} >N N,N NAN, BIX}N, IER) 
CALL VMULFF (BX1I2;,BX2,N,N,N,N,.N,BIX2,N,I1IER 
CALL VMULFF BXI} .MBX.N.N,1,N.N, BIE} sNTER) 
CALL VMULFF (BX12;>MB2X;N:N.1.N.N,BIP2.N.IER 
CALL VMULFM aay ge sada ee eee 
CALL VMULFM (MB2X; IKXY2;N;1,N\N.N.MBX2;1;IER 
CALL VMULFF (MBE) BE). 1 Maths Mate Ble 
CALL VMULFF (MBX2,BX2,1,N,N,1,N,MIX2,1.1ER 
CALL VMULFF ee MBL 1, ,1,1,N,MXM1,1,I 4 
CALL VMULFF (MBX2;>MB2X,1;N,1,1,N;MXM2.1-;IER 
DO 1301. 

B4 (1 )=2.*(MKY1(I)-MKY2(I)) 

DOMINGO 4) = lem 
Aa (I JJ=IKY2 (1 J 5 EKYI(T.J) | 
SUM13=S$UM13+MY2 ag ca }SMY2(J) 
4 -MY1(I)*IKY1(1I,J)*MY1(3) 
C4=SUM13+DLOG(DKY2/DKY1) 
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140 


160 


a0 an 


mrmaAnaaANnnNA 
>) 
>) 


00 M&S 
re 
© 


an 


220 


+ 
CONTINUE 


I=1.N 
B3(1)=ByR2(1 +MIX2 I -IXB2(I X2 (I 
-(BIPL(L)+MIX1 oa il rj. -MBX1(1)) 
DO 140 J=1;N 
A3(@,J)- ie (3 i)- att 3) 
=P )#BIX2 
(TREY ( Isa eat F 
panlael:. 53 TXitT. Jip) 


C3=MXM2 -MXM1+DLOG (DKXY2/DKXY1) 


SUM12+B3(1)*X(I) 
DO 150 | | 
SUM11=SUM11+X(1)*A3(1I,J)*X(J) 


CONTINUE 
RPX=0.5*(SUM11+SUM12+C3) 


SUM15+B4(1)*Y(I) 
=SUM14+Y(1)*A4(I,J)*Y(J) 
°(SUM14+SUM15+C4) 


Tella 
ke 


VA=RPX+RY 


LIF (VANCE. Pe 
CLA= 


NCLA1L=NCLA1+1 


ok 


CLA=2 
Berane Cease it 


nts ales ates ate ale ale ale ale als ate ale ale atc alc atc ate ale ale aleatsatocalec aleoatecatscalcatscalcalcalcatec 
OC FU TU FU FU FRU FU STR FU FR FY GY FX FR FGA F% FR GY FX FX FRC FY FX Fa FE FY FY FY FY FY FY 


fam! $0 Poo ate mle alo nto alo alo ato ates C Ah ate alec als ale ate ate ale ale alec ale ala 

ver ye Fa FX FR FR FR FX FX FX FY Fe Fe Fe Fe FB FX FX FR FR FX FX 
$ ate ato atc alc atc atc ate alaate als alcatcalc alc atc alcalc ate atc atonal ale ate aleoatoals alcalealtcaltec 
we PR FU FV FRY EY FY FRY FRX FY GX FB FU FY Fe FX FRY FY FR FU FB Te EY FT FY FX FX FY FX FY 


DO 210 [=1,N 


fanaa (7} BaF) 


CONTINU 
CALL VMULFF BELA AMAT MN Pot N Berm aER 
CALL VMULFF (BBZK xMxX2 MeN eee 12 PT, eee 


DO 220 IT=1,M 

MBT1 1)2My 4 I-)+BYT1 q} 

MBT2 (I )=MY2(1)+BYT2(I 
CONTINU 
CALL VMULFF (IKYX1,MBT1,M,M,1,M,M,KBT1,M,IER 
CALL VMULFF (IKYX2>MBT2°>M/M)1°M°M-KBT2°>M; IER 
CALL VMULFM (MBT} ,IKYX1L,M M,1,MoM.M.MBK1, 1, TER) 
CALL VMULFM (MBT2;IKYX2>M?1°M;M;3M;MBK2;>1;IER 
CALL VMULFF (MBK1,MBT1,1, Ms 1, 2.M MEL, 1, TER) 
CALL VMULFF (MBK2?>MBT2;1°M;1°1;3M;\MT2;1°IER 
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A200 AN 


aAaNNn 


PANANAANANANAAAN 


DO 240 
DO 
CONTIN 


5(T)"KBT1(1)+MBK1 (I) - (KBT2(I)+MBK2(I)) 
9(I,J)*IKYX2(1,J)-IKYX1(I,J) 


C5=MT2-MT1+DLOG (DKYX2/DKYX1) 


CPryw 


DO 260 I=1,M } 
SUM25=SUM25+B5(1)*Y(L) 
DO 260 J=1,M : ) 
SUM24=SUM24+Y(1L)*A5(I,J)*Y(J) 
CONTINUE 
RBY=0.5*(SUM24+SUM25+C5 ) 


V=RX+RBY 


IF(V.GT.T) THEN 
CL=1 


NCLI=NCL1+1 
ELSE 


NCL2=NCL2+1 
END IF 


WRITE(7,*) VAL,VA,V 
WRITE 7.298 CLASS, 
Beer’ U3 732,¥> 8 Tax CF 





ae ox. e3t75~ 

GO TO 45 
RATEA1=100.*NCLASL/L 
RATEA?2= 100 ENCLAS2/L 
RATEB1=100.*NCLAL/ 
RATEB2=100 ENCLA2/L 
RATECI=100.*NCL1/ 
RAWEC2=100.=NCL2/L 
WRITE(7,*) L,NCLAS1,NCLA1,NCL1 
WRITE(7,*) RATEAL,RATEB1,RATECL 
WRITE(7,*) L,NCLAS2 ,NCLA2 ,NCL2 

ITE(7,*) RATEA2,RATEB2, RATEC2 
END. 
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INTEGERS 
+ 


APPENDIX D 
ANAL FORTRAN 


This program counts the number of ve0rrecteaceisions 
of three algorithms and calculates the correct 


decision rates of them 


REAL*8 T,PRW1,PRW2 
+ 


RATEA1.RATEA2 , RATEB1, RATEB2 , RATEC1, RATEC2, 
VAL (128), VA(128),V(128) 


er Aas’ 
Neral. CNCLAT? NCL1, 
NCLAS2 ; NCLA2 )NCL2’ 


L=128 


a RE ad (30 *) VAL(I),VA(I),V(T) 
CONTINUE 


PRW1=0.005 
PRW2=1.-PRW1 
T=DLOG(PRW2/PRW1) 


NCLAS1=0 
NCLAS2=0 


30 

IF (VAL( 1).GT.T) THEN 
_NCLAS1= NCLAS1+1 
CLASS=2 
NCLAS2=NCLAS2+1 

END IF 

IF (va(t). .GT.T) THEN 


NCLAL=NCLAI1+1 
PiSic: 


CLA= 
NCLA2=NCLA2+1 
END IF 


TE (V Cl eG Te es) 
abet? S-?) 
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QNWAN 


QO 


QO 


maa a aan annanana annnnanann 


NCLI=NCLI+1 
ELSE 


CL=2 
NCL2=NCL2+1 
END IF 

CONTINUE 
RATEA1=100.*NCLAS1/ 
RATEA2=100. — 
RATEB1=100.*NCLAL/L 
RATEB2=100. sNeEa ye 
RATEC1=100.*NCL1/L 
RATEC2=100. *NCL2/L 
WRITE (7,*) CLASS,CLA,CL 


WRITE (7,%*) PRW1,PRW2,T,L 

WRITE (7,%) NCLAS1,NCLA1,NCL1 
WRITE (7,%) RATEA1,RATEB1, RATECL 
WRITE (7,%) NCLAS2,NCLA2 ,NCL2 
WRITE (7,%*) RATEA2,RATEB2, RATEC2 


PRWL=PRW1+0.005 


PE CERW LaCEry Om COunOe2o9 
COMmne 120 


STOP 
END 
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APPENDIX E 
GRAPH4 DATA 


These data files show the correct decision rates 

of 4 dimensional observation vectors. The first 
data is ANALI1 which represents case 1 and class 1 
results. The capital letters "A" and "B" represent 
distributed decision rules A and B, and "C" means 
the centralized decision rule. 

The varying prior probability Pr(wl) is given in 


the first veotunm. 
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APPENDIX F 
GRAPH32 DATA 


These data files show the correct decision rates 
for 32 dimensional observation vectors. The first 
data is ANAL11 which represents case 1 and class l 
results. The capital letters "A" and "B" represent 
distributed decision rules A and B, and "C" means 
the centralized decision rule. 

ine varyrme peior probability Pr(wl) is given in 


Boe first coltimn. 
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